之前推过一篇 Facebook 的 ConvNeXT，今天又看到一个上个星期新出来的 XFormer，直接把二次的 attention 换成了线性 attention，也是在 ViTs 的基础上想办法减少资源使用。没看到什么别的新奇的地方。主要就是减少 GPU 使用，对数据量要求也低了不少，我没做实验。https://arxiv.org/abs/2201.10271，作者给了代码：https://github.com/pranavphoenix/cxv
BY Data Science Archive
A project of our size needs at least a few hundred million dollars per year to keep going,” Mr. Durov wrote in his public channel on Telegram late last year. “While doing that, we will remain independent and stay true to our values, redefining how a tech company should operate.
Tata Power whose core business is to generate, transmit and distribute electricity has made no money to investors in the last one decade. That is a big blunder considering it is one of the largest power generation companies in the country. One of the reasons is the company's huge debt levels which stood at ₹43,559 crore at the end of March 2021 compared to the company’s market capitalisation of ₹44,447 crore.
Data Science Archive from ye